A Pilot for Evaluating Exploratory Question Answering
نویسندگان
چکیده
We describe a pilot on evaluating exploratory search inWikipedia, the free online encyclopedia. The pilot will be held at CLEF 2006, and brings together both search and navigation, and reading and authoring.
منابع مشابه
A New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression
The development of computer systems and extensive use of information technology in the everyday life of people have just made it more and more important for them to make quick access to information that has received great importance. Increasing the volume of information makes it difficult to manage or control. Thus, some instruments need to be provided to use this information. The QA system is ...
متن کاملHITIQA: A Data Driven Approach to Interactive Question Answering: A Preliminary Report
HITIQA is an interactive question answering technology designed to allow intelligence analysts and other users of information systems to pose questions in natural language and obtain relevant, factual answers, or the assistance they require in order to perform their tasks. Furthermore, our objective in HITIQA is to allow the user to submit exploratory, analytical, nonfactual questions, such as ...
متن کاملA model for quantitative evaluation of an end-to-end question-answering system
(b) to conduct a pilot test of this method, and (c) to perform a formative evaluation of the HITIQA system. Far more important than the specific information gathered from this pilot evaluation is the development of (a) a protocol for evaluating an emerging technology, (b) reusable assessment instruments, and (c) the knowledge gained in conducting the evaluation. We conclude that this method, wh...
متن کاملOverview of QAST 2007
This paper describes QAST, a pilot track of CLEF 2007 aimed at evaluating the task of Question Answering in Speech Transcripts. The paper summarizes the evaluation framework, the systems that participated and the results achieved. These results have shown that question answering technology can be useful to deal with spontaneous speech transcripts, so for manually transcribed speech as for autom...
متن کاملارایه یک پیکره پرسش و پاسخ مذهبی در زبان فارسی
Question answering system is a field in natural language processing and information retrieval noticed by researchers in these decades. Due to a growing interest in this field of research, the need to have appropriate data sources is perceived. Most researches about developing question answering corpus area have been done in English so far, but in other languages as Persian, the lack of these co...
متن کامل